Exploring the origins of the power-law properties of energy landscapes: An egg-box 
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Multidimensional potential energy landscapes (PELs) have a Gaussian distribution for the en- 
ergies of the minima, but at the same time the distribution of the hyperareas for the basins of 
attraction surrounding the minima follows a power-law. To explore how both these features can 
simultaneously be true, we introduce an "egg-box" model. In these model landscapes, the Gaussian 
energy distribution is used as a starting point and we examine whether a power-law basin area 
distribution can arise as a natural consequence through the swallowing up of higher-energy minima 
by larger low-energy basins when the variance of this Gaussian is increased sufficiently. Although 
the basin area distribution is substantially broadened by this process, it is insufficient to generate 
power-laws, highlighting the role played by the inhomogeneous distribution of basins in configuration 
space for actual PELs. 
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I. INTRODUCTION 

Potential energy landscapes describe how the poten- 
tial energy of a system depends on the coordinates of 
its constituent atoms [lj. As the thermodynamics and 
dynamics of a system are controlled by the PEL, there 
has been much interest in exploring the insights into the 
behaviour of relatively complex systems that can be ob- 
tained by characterizing the features of the PEL. Par- 
ticular active research areas for this landscape approach 
have been supercooled liquids and protein folding. For 
example, the dynamics of fragile liquids change at lower 
temperatures, as the system explores low-energy regions 
of the PEL, where the effective activation energies for 
structural relaxation are larger (2j. Furthermore, due to 
the astronomical number of conformations, the Levinthal 
paradox predicts that protein folding would be extremely 
unlikely to occur if these conformations were searched 
randomly Q. However, a funnel on the PEL directs the 
protein towards its folded state [J, Q ■ 

Here, our focus is not so much on how to relate the be- 
haviour of the system to the underlying PEL, but rather 
it is to understand the fundamental properties of PELs 
better. When classifying high-dimensional PELs it is 
common to focus on the stationary points of the PEL, 
particularly the minima and transition states (first-order 
saddle points). Fundamental results concerning these 
stationary points include that the number of minima 
scales exponentially with the system size 0, 0, HI, and 
that the distribution of energies of the minima is Gaus- 
sian. The latter has been found empirically for a range 
of systems and can be justified theoretically from 

the central limit theorem, assuming the system can be 
broken down into independent subsystems (Tl| . 



More recently, a network approach has bee n app lied to 
gain insights into the connectivity of PELs [lj, LL3| • I n 
these "inherent structure" networks, the minima corre- 
spond to nodes, and two nodes are joined by an edge if 
the corresponding minima are directly connected by the 
two steepest descent pathways going away from a tran- 
sition state. Such networks are dynamically motivated 
since if the temperature is not too high, the dynamics 
can be separated into vibrational motion in the basin 
surrounding a minimum with hopping between minima 
via transition state valleys on longer time scales [13, [l5[ . 

Interestingly, for small clusters, for which the complete 
inherent structure networks can be obtained, these net- 
works have been found to be scale-free, that is the degree 
(the number of connections to a node) distribution has 
a power-law tail For such a topology, most of the 

nodes have relatively few connections, but there are a 
small number of hubs that have a large number of con- 
nections, and which play an important role in connecting 
up the landscape. Given that these inherent structure 
networks are based on the adjacency of basins in config- 
uration space, it may seem surprising that the networks 
are so heterogeneous, and not more lattice-like. How- 
ever, the energy of the minima plays a key role, with the 
lower energy minima acting as hubs in the network, be- 
cause they have larger basins of attraction, and so can 
have many transition states along the boundary. Thus 
this leads to a picture with larger basins surrounded by 
smaller basins, which are in turn surrounded by smaller 
basins, and so on. Apollonian packings (see Fig. [1] for a 
two-dimensional example) provide a model of how such a 
hierarchical arrangement can be achieved. Furthermore, 
the network of contacts between the disks in such a pack- 
ing is also scale- free [13, Gil • The analogy holds in one 
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FIG. 1: An Apollonian packing. Space is filled with different 
sized disks, starting from an initial configuration where the 
three larger disks are placed within the bounding circle. The 
packing is generated iteratively, with the largest disk possible 
added to each gap at each iteration. This process is continued 
ad infinitum, thus filling the space with successively smaller 
and smaller disks. 



further way. The distribution of disk areas in the Apol- 
lonian packing follows a power-law. Similarly, the distri- 
bution of basin areas on a range of PELs has also been 
found to follow a power-law with exactly the predicted 
exponent [l9j . 

Despite the success of the Apollonian analogy, one of 
its deficiencies is that it provides no explanation for the 
role of energy in the organization of the landscape. In 
particular, it is not clear how a Gaussian distribution for 
the energies of the minima is compatible with the power- 
law area and degree distributions. The broad area dis- 
tribution implies that there are some very big basins and 
lots of small basins in the landscape, whereas a Gaussian 
energy distribution shows much less variation from the 
mean, and is symmetrical. In order for both of these dis- 
tributions to occur, the dependence of the basin area on 
the energy of a minimum is necessarily very steep, with 
the increase in the area as the energy decreases having 
to be faster than exponential. The aim of this work is to 
explore a model landscape (which we call the "egg-box" 
model) to determine whether the broad area distribution 
might actually be a natural consequence of the Gaussian 
energy distribution, or whether it is due to a particular 
way that PELs are organized. We will describe the na- 
ture and resulting properties of our model landscapes in 
Section m and discuss the implications of the results in 
Section [ml 



II. THE EGG-BOX MODEL 

The idea of our model is to assign minima (which are 
surrounded by harmonic basins) to particular positions 
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FIG. 2: Examples of a one-dimensional egg-box model with 
(a) cr* = 0.01 (b) cr* = 1 (c) cr* = 100, where cr* is the 
standard deviation of the Gaussian energy distribution for 
the minima in reduced units. Initially there are ten minima, 
but as cr* increases, successive minima get swallowed up, until 
there is only one low-energy minimum remaining. 



in configuration space, typically a lattice, e.g. a square 
lattice in two dimensions. If these minima all have the 
same energy, then each basin of attraction will have the 
same area, and the same connectivity. This, if you like, 
is the "egg-box" limit. However, if instead the energies 
of the minima have a Gaussian distribution of sufficient 
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FIG. 3: (Colour online) Variation of the basin area distribu- 
tion with the width of the Gaussian energy distribution for 
the one-dimensional egg-box model, (a) Area distributions, 
(b) cumulative distributions, with the area measured with re- 
spect to its mean. Each is for the one dimensional system 
with 15 625 minima initially (some may be eaten) . 

variance, there is the possibility that some of the higher- 
energy minima will get swallowed up by the basins of 
lower energy minima, as illustrated in Fig. [5] This pro- 
cess will inevitably lead to a broader area distribution 
and, for dimension greater than one, a broader degree 
distribution. But, the question is whether it will be suffi- 
cient to generate the power-law area and degree distribu- 
tions that have been empirically observed for real PELs. 

More formally, the potential energy for our model is 
given by 

F(r) = min[{K(r)}], (1) 

where 

V l {r) = E l + h\v-r l \ 2 , (2) 

Yi is the site of a harmonic potential and Ei is the energy 
at its bottom. Each site will give rise to a minimum on 
the PEL, except for those sites where V(i"i) < E^. For 
the sites of the initial minima we use a hypercubic lattice, 




FIG. 4: Example of the egg-box model in two dimensions. 
The grid shows the positions of the initial minima, the black 
squares represent those that remain at a* — 1, and the thick 
lines represent the boundaries of their basins of attraction. 

and apply periodic boundary conditions. The parame- 
ters of this egg-box model are the lattice spacing a, the 
force constant k of the harmonic potential surrounding 
each minimum, and the mean E and standard devia- 
tion a of the Gaussian. We always centre the Gaussian 
at zero, leaving three remaining variables, two of which 
define the units of energy and length, with one effective 
parameter. We use a and ka 2 as the units of length 
and energy respectively, and choose to vary a* = a/ka 2 . 
As already mentioned, as a* is increased the landscape 
becomes more heterogeneous (Fig. [5]). One obvious ques- 
tion is whether this evolution reaches some kind of steady 
state. The results in Fig. [3] for a one-dimensional exam- 
ple show that although the mean basin area will continue 
to increase with a*, the distribution tends to a limiting 
form. We focus on the landscapes produced in this limit 
since this is when the area distributions will be at their 
broadest. Fig. [3] suggests that landscapes with a* = 1 
will be sufficient for this purpose, and this is the value 
we generally use. 

In order to compare to the egg-box model to PELs, 
we of course need to examine the model in higher di- 
mension. Some of these effects are illustrated in the two- 
dimensional example shown in Fig. dJ Firstly, the basins 
exhibit a wider range of areas. However, the area distri- 
bution is clearly much narrower than that for the Apollo- 
nian packing in Fig.[TJ and there is no sign of any hierar- 
chical ordering. Secondly, as the dimension is increased, 
more basins are eaten because each basin has more neigh- 
bours and the largest possible degree increases. 

Quantitative results have been obtained for systems 
with up to six dimensions and around 15 625 initial min- 
ima. For higher dimensions, analytical approaches to de- 
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FIG. 5: (Colour online) Variation of the cumulative basin 
area distribution with the dimension of configuration space for 
d = 1-6. In (a) the distribution is plotted against the absolute 
area, whereas in (b) the area is measured relative to its mean 
value. Also shown is the power-law P C um(A) ~ A^ 1 which is 
the form seen for high-dimensional Apollonian packings [13] 
and various PELs Hal. 



termine the shapes of the basins, and hence their areas, 
become increasingly involved, so we instead use a Monte 
Carlo approach. A large number of points were chosen at 
random and the basins to which the points belong were 
determined. The area of a basin is then proportional to 
the number of points assigned to that minimum. Area 
distributions are shown in Fig.[5]for increasing dimension. 
There is a wider range of basin sizes in higher dimension, 
where small changes in radius have a larger effect. The 
average and maximum areas also increase because more 
basins are eaten. 

In the results shown so far, the minima have initially 
been placed on a lattice. We also consider landscapes 
where the initial minima have instead been given ran- 
dom positions. As shown in Fig. [6l this broadens the 
area distribution because the starting points are less uni- 
formly separated. For example, when a* — 0, the area 
distribution is a delta function if the basins start on a 



FIG. 6: (Colour online) Effect of the positions of the initial 
minima on the basin area distribution for 1-3 dimensions. 
Dashed lines are for when the initial minima are on a lat- 
tice (as for Fig. [SJa)) and solid lines are for when they are 
distributed randomly. 



hypercubic lattice. However, there will be some hetero- 
geneity if the basins are given random starting points, 
leading to a broader distribution. This effect is weaker 
in higher dimensions, and so the choice of the initial sites 
becomes less important. 

We can compare the area distributions seen for the 
egg-box model to that seen for PELs [l9| and for the 
Apollonian packing [l7| . The latter two both follow a 
power-law with exponent close to —2 (or —1 for the cu- 
mulative distribution), and such a power-law has also 
been plotted in Fig. [5] for comparison. This form is tan- 
gential to the observed basin area distributions, but only 
for a small range of areas, and the distributions show sig- 
nificant curvature. By contrast, the area distributions for 
PELs associated with common model liquids followed an 
approximate power-law over up to 18 decades. However, 
the configuration space for the latter had 765 dimensions. 
Therefore, it is natural to ask whether in the limit of 
much higher dimensions the egg-box model might show 
similar behaviour. 

Extending our results to significantly higher dimen- 
sions, however, is not feasible because of the rapidly in- 
creasing number of lattice points required. Instead, our 
approach is to see whether the trends with increasing 
dimension are in the right direction to make a power- 
law a possibility. In this regard, the variation of basin 
area with energy of the minimum is particularly informa- 
tive (Fig. [7]). As expected, low-energy basins are bigger. 
Furthermore, the energy-dependence of the basin area 
becomes steeper with increasing dimension, because the 
maximum area increases, giving a wider range of areas, 
and E max decreases as high-energy basins are more likely 
to be eaten. Furthermore, small changes in radius have 
a larger effect due to the higher dimension. 

Most importantly, the curvature of log A(E) is nega- 
tive. This contrasts with the PELs studied, which showed 
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FIG. 7: (Colour online) (a) Basin area and (b) average ra- 
dius as a function of energy for dimensions 1-6. Each point 
represents an average of those minima in a given energy bin. 



the positive curvature that is necessary to give rise to a 
power-law area distribution. In the egg-box model, as 
we go to lower energies, the curve gets flatter. There- 
fore, we have to go to much lower energies to see basins 
with big areas, but a Gaussian energy distribution means 
that very low-energy minima are very rare. Furthermore, 
at high energy, there is a steeper cut-off for the egg-box 
model, meaning there are fewer small basins. This is in 
the region of the tail of the Gaussian distribution, where 
A(E) would need to be shallow in order to see lots of 
high-energy, low-area basins, as is seen in PELs. 

These trends suggest that, with increasing dimension, 
the egg-box model will not become more like PELs. On 
the contrary, the negative curvature becomes even more 
pronounced. This is confirmed on examining the depen- 
dence of the radius on energy in Fig. Efb), where the 
radius of a basin was calculated from the area by assum- 
ing that the basin was hyperspherical. r(E) is almost 
linear, and seems to be tending towards a limiting form, 
thus further implying that the curvature of log A(E) will 
be even more negative in higher dimension. 
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FIG. 8: Cumulative degree distribution for the two- 
dimensional egg-box model with a* = 1. 



Some network properties for the two-dimensional egg- 
box have also been studied. Initially, there were 15 625 
minima. As some of these are eaten, the final number of 
minima is N = 4140, so the size of the network is very 
similar to that of the ISN for the 14-atom cluster LJ14 
studied previously [l2| . The number of edges in the net- 
work is M — 12 142, giving an average number of connec- 
tions per node (average degree) of (k) = 2M/N = 5.87. 
This can be directly compared to the ISN of LJ14, which 
has (k) = 29.12. Therefore, the egg-box model has much 
lower overall connectivity than the PEL. The maximum 
connectivity, k max = 13, is again much lower than that 
seen for LJ14, where the highest-connected basin is con- 
nected to 3201 others. 

The degree distribution for the 2D egg-box model is 
roughly exponential, as shown in Fig. [H] By contrast, 
the networks associated with PELs and the Apollonian 
packing have scale-free character, i.e. their degree distri- 
butions follow power-laws. This behaviour is due to the 
presence of some very large basins, with very long bound- 
aries, which have high degree and act as hubs, connecting 
up the networks. By contrast, the egg-box model features 
neither very large basins to act as hubs, nor many small 
basins around their boundaries, as evident from compar- 
ing Figs. Q] and [4] 

The network of the egg-box model has very long paths 
between nodes. This result cannot be compared directly 
to the PELs due to the different sizes and connectivity 
patterns, both of which affect path lengths. However, if 
we compare the path length of the egg-box to that of a 
random network of the same size and having the same 
degree distribution, we see that the average path length 
is roughly four times that of the random network. By 
contrast, for the PEL of clusters LJ7 to LJ14, the path 
length is between 1-1.05 times that for a random network. 
The egg-box model therefore has very long path lengths. 
The egg-box model is also very highly clustered, i.e. the 
neighbours of a node are also likely to be connected. Its 
clustering coefficient [2(| is approximately 30 times that 
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for a random network, compared to roughly 1.6 times for 
the ISN of LJ 14 . Therefore, with its long path lengths 
and high clustering, the egg-box model has very similar 
properties to a lattice. Despite the broadening of the area 
distribution resulting from the swallowing up of higher- 
energy minima as a* is increased, the contact network 
between the basins does not change its essential charac- 
ter. Although it is possible that these properties may 
change for higher dimensions, it has been shown that 
PELs behave differently to high-dimensional lattices, in 
particular having shorter path lengths [H, [l3[ . 

III. CONCLUSIONS 

The aim of this paper was to determine whether the 
power-law area distribution observed in PELs is a natural 
consequence of a Gaussian distribution of energies for 
the minima, or whether it reflects further ordering of the 
PEL. We do see some of the expected trends. Increasing 
the width of the Gaussian leads to a broadening of the 
area distribution, where lower-energy basins have higher 
area and higher degree. However, this is not sufficient to 
reproduce the properties of real PELs. In some ways, this 
might be regarded as a negative result, however, it allows 
us to get a better understanding of what the key features 
of real PELs are that lead to the observed properties. 

Some assumptions are used in the egg-box model that 
constitute possible causes of the differences between the 
resultant model landscapes and PELs. Firstly, the di- 
mension of the models studied is much lower than that 
for PELs of all but the smallest systems. However, the 
trends for the dependence of the area distribution on di- 
mension that we observed are not going in the right direc- 
tion. Thus higher-dimensional model landscapes are un- 
likely to correct the deficiencies of the lower-dimensional 
models examined here. 

Secondly, we assumed that the basins have a harmonic 
form. Generally, it is found that applying the harmonic 
approximation to the basins of real PELs gives a correct 
qualitative description of the systems' behaviour (2ll.[2^|. 
and so we think this assumption is unlikely to have a 
significant effect on our conclusions. Thirdly, we assumed 
that the force constant k was the same for all basins, 
independent of the basin energy. However, given that the 
vibrational frequencies for clusters [23|,[24[ and for liquids 
at constant volume [25[ have an opposite dependence on 
energy, yet the PELs of examples of both of these types of 
system have been seen to have broad area distributions 
[19(, we think this assumption is unlikely to have too 
much effect. 

Fourthly, there is an absence of correlations between 
neighbouring minima in the egg-box model, i.e. the as- 
signed energy of an initial minimum is independent of 
that of its neighbours. However in real landscapes, the 
energies of neighbouring minima are correlated with min- 
ima more likely to be connected to others of similar en- 
ergy [l3|. The likely effect of such correlations on the 



current model would be to increase the number of high- 
energy minima as they are less likely to be swallowed 
up if they are surrounded by minima of similar energy, 
and to decrease the area of lower-energy basins as they 
are more likely to be surrounded by other lower-energy 
minima restricting the growth of their basins. Thus the 
dependence of the basin area on energy would be likely to 
be less steep, and in itself the introduction of correlations 
into our model is unlikely to lead to a further broadening 
of the area distribution. 

Fifthly, there is the homogeneous distribution of ini- 
tial minima in the egg-box model. Both the lattice and 
the random initial configurations lead to an essentially 
uniform density of points, in contrast with the Apol- 
lonian packing which is very heterogeneous, with small 
basins clustered in the gaps between larger basins. Such 
an inhomogeneous distribution of minima combined with 
energy correlations, where the high-energy minima are 
more closely spaced and the low-energy minima are more 
separated, would potentially lead to larger areas for the 
lower-energy minima and a greater number of small high- 
energy minima, thus impacting on the curvature of A(E) 
and broadening the area distribution. 

Thus, the differing properties of our egg-box model 
landscapes and real PELs are most likely due to the inho- 
mogeneous distribution of minima in configuration space, 
and the hierarchical nature of the packing of the basins 
of attraction on the PEL. This conclusion therefore high- 
lights the role these features play in giving rise to the 
power-law basin area distribution observed. 

But, this of course, begs the question what then are 
the sources of the inhomogeneity. This will be the sub- 
ject of future work, but some partial answers come from 
a further difference between the egg-box model and real 
PELs, namely the lack of a corresponding real space 
atomic structure in the egg-box model. For example, 
high-energy minima on a real PEL will correspond to dis- 
ordered configurations, where the structure is frustrated. 
It has been found that such structures have many non- 
diffusive modes, which have small barriers leading to dif- 
ferent minima, but involve no real reordering of atom 
positions . Thus there will be a high density of high- 
energy minima with small basins clustered together. By 
contrast, for lower-energy minima the local environment 
around each atom is likely to be much closer to opti- 
mal, and to go between basins requires following a diffu- 
sive mode where there is a significant reordering of the 
atomic positions, associated with some atoms escaping 
from their caging environments. Thus, the organization 
of the PEL and the atomic structure are intimately re- 
lated. 
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